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Abstract — The three-user finite field multi-way relay channel 
with correlated sources is considered. The three users generate 
possibly correlated messages, and each user is to transmit its 
message to the two other users reliably in the Shannon sense. As 
there is no direct link among the users, communication is carried 
out via a relay, and the link from the users to the relay and 
those from the relay to the users are finite field adder channels 
with additive noise of arbitrary distribution. The problem is 
to determine the set of all possible achievable rates, defined 
as channel uses per source symbol for reliable communication. 
For two classes of source/channel combinations, the solution 
is obtained using Slepian-Wolf source coding combined with 
functional-decode-forward channel coding. 

I. Introduction 

In this paper we study the three-user finite field multi- 
way relay channel (MWRC) with correlated sources, where 
each user is to transmit its data to the other two users 
reliably (in the Shannon sense) via a single relay. For two 
classes of source/channel combinations, we obtain a complete 
characterization for reliable communication, i.e., the set of all 
achievable rates, defined as channel uses per source symbol. 

The MWRC is an extension of the two-way relay channel 
where two users exchange data via a relay [fl~)-(|6). One 
application of the MWRC with correlated sources is the com- 
munication of weather stations via a satellite, where multiple 
stations obtain measurements of their respective local weather 
condition, and each station is to obtain the weather conditions 
at all other stations by communicating with a satellite. 

We study the MWRC in which each user is to decode the 
data from all other users, and where there is no direct link 
among the users. Communication is carried out via a single 
relay. This system has been studied from the point of view 
of channel coding and source coding, independently, under 
different setups. 

In the channel coding setups, the sources are assumed to be 
independent, and the channel noisy. The problem formulation 
is "how many bits of data can each user send per channel use?" 
Achievable rate tuples here refer to the tuple of the number 
of message bits (per channel use) the users can transmit such 
that all other users can reliably recover their messages. The 
challenge is to find the capacity region which is the closure of 
all achievable rate tuples. Though the capacity region of the 
general MWRC remains unknown, Gundiiz et al. Q obtained 
asymptotic capacity results for the high SNR and the low 
SNR regimes for the Gaussian MWRC, and Ong et al. 0, 
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Fig. 1. The three-user finite field MWRC with correlated sources 



derived the capacity region of the finite field MWRC, which 
is achieved by functional-decode-forward channel coding. 

In the source coding setups, the sources are assumed to be 
correlated, but the channel noiseless. The problem formulation 
is "how many bits does each node need to encode per message 
symbol?" Achievable rate tuples here refer to the tuple of the 
number of bits (per source symbol) allocated to the encoders 
for which reliable reconstruction of each message is possible 
by all other users. The challenge is to find the set of all 
achievable rate tuples. The source coding problem for the 
three-user MWRC was solved by Wyner et al. ffTOl . using 
cascaded Slepian-Wolf source coding ifTD . 

In this paper, we study both source and channel coding 
in one setup, i.e., the three-user MWRC with noisy channel 
and with correlated sources (see our recent work lfl2l on 
the two-user MWRC with correlated sources). In the multi- 
terminal network, it is well known that solving the source 
coding and the channel coding problems separately does not 
solve the source-channel problem, i.e., noisy channels with 
correlated sources (see, e.g., the multiple-access channel lfL3l ). 
We will, however, show that a strategy using Slepian-Wolf 
source coding (an optimal source coding) and functional- 
decode-forward channel coding (an optimal channel coding) 
is optimal for two classes of the finite field MWRCs with 
correlated sources. Using an example, we will also show that 
this scheme might not be optimal in general. 

II. Main Results 

A. Channel Model 

Referring to Fig. Q] nodes 1, 2, and 3 are the users and node 
the relay. Let Wi be the message of user i, and each message 



triplet (Wi, W 2 , W3) be independently generated according to 
p(wi, W2, W3), The memoryless finite field channel is defined 
by (i) the uplink: Y Q = Xi © X 2 © X 3 © N and (ii) 
the downlinks: Yi = Xq © Ni, for i £ {1,2,3}, where 
Xj,Yj,Nj e I, Vj £ {0,1,2,3}, where J 7 is a finite field 
with addition ffi, Xj is the channel input from node j, Yj is the 
channel output received by node j, and Nj is the receiver noise 
of node j. The noise terms N/s are independent for each user 
and for each channel use. If the users can reliabljQ exchange 
m message triplets in n channel uses, the rate of k = n/m 
channel uses per source symbol is said to be achievable. 

B. Definitions 

Before presenting the main results of this paper, we define 
the following properties for the sources and the channel: 
The channel is 

• symmetrical, if all the downlinks from the relay to the 
users are equally noisy, i.e., H(Ni) = H(N 2 ) = H(N 3 ); 

m asymmetrical, otherwise. 

Remark 1: For a symmetrical channel, we do not impose 
the constraint that the "noise power" at the relay, H(Nq), must 
equal that at the users. This means that all downlinks from the 
relay to the users are equally noisy, but the uplink from the 
users to the relay can be noisier or less noisy. 

The sources have 

• almost-balanced conditional mutual information 
(ABCMI), if 

I(Wi]Wj\W k ) < I(Wj;W k \Wi) + IiWiMWj), 

Vi.j.fc € {1,2,3} and i + j + k; (1) 

• unbalanced conditional mutual information, otherwise, 
i.e., there exists some user A e {1, 2, 3}, such that 

I(W B ; W c \W a ) = I(W A ; Wb\W c ) 

+ I(W A -Wc\W B )+i ll (2) 

for some 77 > and B,C e {1, 2, 3}\{A} where B^C. 
Note that if (Q~|) fails, then there necessarily exists an appro- 
priate ?y as in (ffj). 

For the class of sources with unbalanced conditional mutual 
information, we say that the sources have skewed conditional 
entropies (SCE) if in addition to (0, we have the following: 

H(W B ,W C \W A ) >max{H(W A ,W B \W c ), 

H{W a ,W c \Wb)}+V, (3) 

for the same 77 as in (f2]). 

Fig. |2] shows the relationship among the entropies and 
mutual information for the three source messages Wu W2, and 
W3 for the cases of ABCMI and SCE. Referring to Fig. [2(a)] 
the shaded areas refer to the mutual information between any 
two source messages given the third source message. For 

'Reliability is defined in the Shannon sense, i.e., the probability that any 
user wrongly decodes any other user's message can be made as small as 
desired. 
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ABCMI, we have that any of the three shaded areas must 
not be bigger than the sum of the other two shaded areas. 
Suppose that the sources do not have ABCMI, then they must 
have unbalanced conditional mutual information, i.e., we can 
find a user A where I(Wb; Wc\W a ) is larger than the sum of 
I(W A ; Wb\Wc) and I(W A ; Wc\Wb) by an amount 77 (see 
Fig. |2(b)| >. In addition, for sources with SCE, we also have that 
for the two messages, Wb and Wc, whose mutual information 
conditioned on W A , i.e., I(Wb', Wc\W A ), is larger than the 
sum of the other two pairs by the amount 77, their entropy 
conditioned on W A , i.e., H(Wb, Wc\W A ), is also greater than 
that of any other pair (conditioned on the message of the third 
user) by at least 77. 

C. Main Results 

In this paper, we show that for the two cases of (i) sources 
with ABCMI, and (ii) sources with SCE on symmetrical 
channels, necessary and sufficient conditions for a rate k > 
to be achievable are 

H(W h W k \Wi) < K [log 2 |^| - m^x{H(N ),H(N 1 ,)} 

Vi,j,ke {1,2,3} wdi^j^k. (4) 

For the remaining cases, the above conditions are necessary, 
but may not be sufficient. For these cases, we obtain sufficient 
conditions for achievability, but there remains a gap between 
(|4]i and the sufficient conditions presented. The results are 
summarized in Table |T] 

Remark 2: Utilizing feedback is permitted in our system 
model. Consider m message triplets, and define Wi = 
(Wi[l], . . . , Wj[m]). The transmitted channel symbol of 
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node i at any time t is a function of its own mes- 
sages and its past received channel symbols, i.e, Xi[t] = 
fi,t(Wi,Yi[l] Yi[t]), Vt e {l,...,n},V* G {0,1,2,3}, 
where Wo = 0- After n channel uses, each user i then 
estimates the messages of the other users using its own mes- 
sages and its n received channel symbols, i.e., (Wj, Wk) = 
gi{Wi,Yi[l], . . . ,Yi[n]), Vi, j, k e {1, 2, 3} where i^j^k, 
and j < k. 

Now, we will prove the above results in Sections II7TI4IVI 
III. Conditions for Achievability 

A. Necessary Conditions for Achievability 

We can show the following necessary conditions for achiev- 
ability: 

Theorem 1: Consider a three-user finite field MWRC with 
correlated sources. If a rate k > is achievable then 



H(W ] ,W k \W l ) < k log 2 \T\-max{H(N ),H(Ni)} 



(5) 



for all k € {1, 2, 3} where i ^ j ^ k. 

To prove the above necessary conditions for achievability, 
we first extend the cut-set argument in lfT4l pages 587-591] 
for networks with independent sources to those with correlated 
sources. We then apply the cut-set argument for networks with 
correlated sources to the three-user finite field MWRC. The 
proof is omitted because of space constraints. 

B. Sufficient Conditions for Achievability 

We can also show the following sufficient condition for 
achievability: 

Theorem 2: Consider a three-user finite field MWRC with 
correlated sources. For any k > 0, if there exist three non- 
negative real numbers R%, R2, and R3 satisfying 



Ri > -H(W i \W j ,W k ) 

Rj + Rk > -H(W j ,W k \W i ) 

Rj + Rk < log 2 1-7=1 - max{H(N ),H(N. l )}, 



(6) 

(7) 
(8) 



for all k G {1, 2, 3} where i ^ j ^ k, then the rate k is 
achievable. 

Remark 3: Ri in the above theorem is the "rate" (in bits per 
channel use) of the encoded message at which node i transmits 
on the uplink, for i G {1, 2, 3}. 

Sketch of proof for Theorem [2} To prove the above suf- 
ficient condition for achievability, we use the techniques of 
(i) Slepian-Wolf source coding for the noiseless MWRC with 
correlated sources flOl , and (ii) functional-decode-forward 
channel coding for the finite field MWRC with independent 
sources We first use Slepian-Wolf source coding: each 



user i encodes its message Wi to an ni?i-bit message Mj, 
for i G {1,2,3}. We then use functional-decode-forward 
channel coding on the finite field (noisy) channel: each user 
i transmits Mi using a random linear code; the relay decodes 
a linear function of messages (Mi, M2, M3), denoted by U, 
and forwards U back to the users. If ([H) is satisfied, each user 
i can decode the encoded messages of the other users, i.e., Mj 
and Mfc. Furthermore, if (JSJ — ([Vj are satisfied, each user i can 
recover (Wj,Wk) from (Wi, Mj, M k ). Note that the source 
codes and the channel codes can be designed separately and 
independently. The detail of the proof is omitted because of 
space constraints. 

In the rest of this paper, we denote the above coding strategy 
of using Slepian-Wolf source coding and functional-decode- 
forward channel coding by SW-FDF. 

Remark 4: SW-FDF proposed here is not simply selecting 
appropriate channels to support the source coding operation 
in ifTOl . In ifTOl . the relay obtains Mj from each user i on the 
uplink, Vi. It then creates random bins for (Mi, Mi, M3), and 
sends the bin index Mo to the users. In SW-FDF, we do not 
merely find channels to support the above, i.e., uplinks that 
allow the relay to decode (Mi,M2,M3), and downlinks that 
allow the relay to send Mo to the users. In fact, we previously 
showed that having the relay fully decode (Mi, Mi, M3) can 
be sub-optimal J9)- In SW-FDF, we first use the idea in 
Slepian-Wolf source coding to generate (Mi,M2,M3), and 
then use functional-decode-forward for the relay to decode 
a function of (Mi,M2,M3), which depends on the channel 
codes chosen, and then forward this function to the users. 

Remark 5: Conditions ©-dHJ imply (0 in Theorem Q] In 
addition, we require © for all i, j, k G {1, 2, 3} where i ^ j ^ 
k, which are source coding constraints, to guarantee reliable 
communication using SW-FDF. 

IV. Necessary and Sufficient Conditions 

Now, we find conditions under which the above necessary 
and sufficient conditions match. Note that any three-user finite 
field MWRC must belong to one of the following two classes. 

A. Sources with Almost-Balanced Conditional Mutual Infor- 
mation (ABCMI) 

For ABCMI, we have the following constraints: 

I(Wi] Wj\W k ) < I(W 3 ; W k \W t ) + I{Wi\ W k \Wj), 

Wi,j,ke {1,2,3} and i^j^k. (9) 

We first show the following lemma. 

Lemma 1: Consider three (possibly correlated) random 
variables Wi, Wi, W3, and a positive number k. If (0 is 



true, then we can always find three non-negative real numbers 
R X ,R 2 ,R 3 > 0, such that 



true, then we can always find three non-negative real numbers 
Ra,Rb,Rc > 0, such that 





kRi 


> H{Wi\W 2 ,W 3 ) 


(10) 




kR a = H(Wa\Wb,W c ) 


(19) 




kR 2 


> H(W 2 \W X ,W 3 ) 


(11) 




kRb > H{W b \Wa,W c ) 


(20) 




kR 3 


> H{W 3 \W U W 2 ) 


(12) 




kR c > H{W c \W Al W B ) 


(21) 


k(Ri - 


hR 2 ) 


= H(Wi,W 2 \W 3 ) 


(13) 


k(R a - 


f R B ) = H(Wa,Wb\W c ) 


(22) 


k(Ri - 


\-R 3 ) 


= H(Wi,W 3 \W 2 ) 


(14) 


k(R a - 


^Rc) = H{Wa,W c \Wb) 


(23) 


k(R 2 - 


^R 3 ) 


= H(W 2 ,W 3 \Wx). 


(15) 


k(R b - 


^Rc) = H(Wb,W c \Wa), 


(24) 



Proof of Lemma [7} It can be shown that choosing 
1 



K R i = H(W i \W j ,W k 



IiWaWklWj) 



KW^W^Wu) - IiW.j-W^Wi) 



(16) 



for i, j, k e {1, 2, 3} and i ^ j ^ k satisfies (TTOt — dT5T>. ■ 
We now show that for ABCMI, i.e., when (O is true, the 
necessary conditions in Theorem Q] are sufficient for reliable 
communications. Let k be any rate that satisfies Q. First, 
choosing R%, R 2 , and R 3 in ( PToT l. from Lemma Q] ©-dill are 
satisfied. Substituting (fl~3T>— (TT5T> into (0, we get 

R 3 +Rk< log 2 | T\ - max{tf(Ar ), H(N i )}, (17) 

for all k 6 {1, 2, 3} where i ^ j ^ k. This is equivalent 
to (©. This means the rate k is achievable. 

So, we have the following necessary and sufficient condi- 
tions for reliable communications for ABCMI: 

Theorem 3 (ABCMI): Consider a three-user finite field 
MWRC with correlated sources. If the sources have ABCMI, 
then the rate k is achievable if and only if 

H{W j ,W k \W i ) < K [log 2 |7l-max{fr(iVb),fr(iVi)} 

for all i, j, k e {1, 2, 3} where i ^ j ^ k. 

Remark 6: If the sources are independent, we have 
H(Wi, Wj\W h ) - H(Wi) + HiWj) for all k e {1, 2, 3}, 
i ^ j ^ k. In this case, © is always satisfied. So, reliable 
communication is possible if and only if r, +r k < log 2 IJ 7 ) — 
max{iJ(A^ ), H(N Z )}, for all i,j, k G {1, 2, 3} and i ^ j ^ k, 
where r 3 = H(Wj)/K = mH(Wj)/n is the number of 
message bits transmitted by user j per channel use. With this 
we recover the capacity region of the three-user MWRC with 
independent sources J9). 

B. Sources with Unbalanced Conditional Mutual Information 

For sources with unbalanced conditional mutual informa- 
tion, we have the following constraint: there exists some user 
A e {1,2,3}, such that 

I{W B \ W c \W a ) = I(W A \ W b \W c ) + I(W A \ W c \W b ) + V, 

(18) 

for some T] > 0, for some B, C e {1, 2, 3}\ {A}, and B ^ C. 
We can show that if the sources do not have ABCMI (i.e., 
(0 is false), they must have unbalanced conditional mutual 
information. Now we prove the following lemma: 

Lemma 2: Consider three (possibly correlated) random 
variables W\, W 2 , W 3 , and a positive number k. If (fL8b is 



for the ?] > in ( fT8l . 

Proof of Lemma |2} Constraint (fT8l implies that 

I{W B \ W c \W a ) + I{W A \ Wb\W c ) - I(W A \ W C \W B ) 

= 2I(Wa;Wb\W c )+v>0 (25) 
I(W B ; W c \W a ) + I(W A ; W c \W b ) - I{W A ; W B \W C ) 

(26) 



= 2I(Wa;W c \Wb)+v>0. 
Now, we choose 
kR a = H(W a \Wb,Wc) 
kR b = H{Wb\Wa,W c ) + \[i{W B )Wc\Wa) 

+ I(W A ; Wb\W c ) - I(W A ; W c \Wb) 
1 
2 

I(Wa;W c \Wb) - I(Wa;W b \Wc) 



kRc = H(W c \W a ,Wb) + 7 : I{Wb;W c \Wa) 



(27) 



(28) 



(29) 



Substituting (EH) into (|28]l and (|26]l into (|29l . we have 
kR b > H(W B \W A ,W C ) and kR c > H(W C \W A , W B ) re- 
spectively, i.e., (f20b — (f2TT> are satisfied. Summing different pairs 
of <|22]i-<|29]l, we have n(R A + R B ) = H(W A , W B \W C ) + f], 
k(R a + Rc) = H{W A , W C \W B ) + V, and n{R B + R c ) = 
H(W B , W C \W A ), i-e., <|22])-<|24|) are satisfied. ■ 

1) Skewed Conditional Entropies (SCE): Now, we consider 
sources with skewed conditional entropies (SCE), i.e., those 
with unbalanced conditional mutual information with the fol- 
lowing additional constraints: 



H(W B ,Wc\W A ) > H{W A ,Wc\W B ) + V 
H{W b ,Wc\Wa)>H(Wa,W b \Wc) + v, 



(30) 
(31) 

> 



which is equivalent to H(Wb,Wc\Wa) 
max{iT(WA, W C \W B ), H(W A , W B \W C )} + V- 

For SCE, we have the following result: 

Theorem 4 (SCE): Consider a three-user finite field MWRC 
with correlated sources. For SCE, i.e., 

I(W b ;W c \Wa) - I{Wa;Wb\Wc) + I(Wa;W c \Wb) + V, 

(32) 

H{W b ,W c \Wa) > max {h(W a ,W c \Wb), 

H{W a ,Wb\W c )} + v, (33) 

for some A,B,Ce {1, 2, 3}, A ^ B ^ C, and some 77 > 0, if 
the channel is symmetrical (refer to the definition in Sec. lII-Bl ). 
then the rate k is achievable if and only if 



H{W j ,W k \W i ) < re[log 2 \T\ - max{H(N ),H(Ni)} , 

(34) 

for all i,j, k g {1, 2, 3} where i ^ j ^ k. 

Proof of Theorem [?} From Theorem [TJ the rate re is 
achievable only if (l34l is satisfied. 

For the symmetrical channel, we can define H{N&) = 
H(Ni) = H(N 2 ) = H(N 3 ), where the subscript "d" denotes 
downlink. Eqn. d33l for SCE implies that (f34-b reduces to 

H(W B , W c \W a ) < re[log 2 \T\-m a x{H(N ),H(N d )} . 

(35) 

We need to show that for all symmetrical MWRCs where 
the sources have SCE, if (l35l l is satisfied then the rate re is 
achievable. 

From Lemma [2] we can choose three non-negative real 
numbers Ra, Rb, and Rc such that conditions ©-(H) in 
Theorem |2] are satisfied. In addition, for the chosen Ra, Rb, 
and Rc, we have 



k{R b + Rc) = H{W B , W c \W a ) 

< re[log 2 \F\ -max{H(N Q ),H(N d )} 
k(R a + Rb) = H(W A ,W B \W C ) + v 

<H(W b ,W c \Wa) 

< re[log 2 \F\ -mBx{H(No),H(Ni)} 

k(R a + R c )=H(Wa,Wc\Wb)+v 
<H(W b ,W c \Wa) 

< re[log 2 - m- A x{H(N Q ) 1 H(N d )} 



(36) 



(37) 



(38) 



where ([36) follows from ([24) and (|35); 03 follows from ([22), 
d33>, and and (|38> follows from dH, (03), and (f35). The 
above three conditions are equivalent to (0 in Theorem[2] This 
means the rate re is achievable. 

So, for any symmetrical finite field MWRC with correlated 
sources with SCE, the rate re is achievable if and only if (l34l 
is satisfied. ■ 

2) Without Skewed Conditional Entropies: Finally, consider 
sources without SCE but with unbalanced conditional mutual 
information, i.e., ( fT8l with the following additional constraint: 

H(W b ,W c \Wa) < wbx{h(Wa,Wc\Wb), 

H(Wa,Wb\W c )} +v- (39) 

For this case, we will show that SW-FDF might not 
be optimal, i.e., not all rates re that satisfy Theorem [TJ 
are achievable using the coding scheme. We consider the 
source structure depicted in Fig. [3] i.e., H(Wa, Wb\Wc) = 
H(Wa,W c \W b ) = 7 and H{W B ,W C \W A ) = 5, and the 
channel with the following parameters: log 2 — H(Nq) = 7, 
log 2 \T\-H(N l ) = W, Vie {1,2,3}. 

The rate of re = 1 is necessary for reliable communication 
(from Theorem[T). If re = 1 is achievable using SW-FDF, from 
Theorem [2] we must be able to find three non-negative real 
numbers Ra, Rb, and Rc such that 




Fig. 3. An example of sources with unbalanced conditional mutual infor- 
mation and without SCE 

Ra > 5 (40) 

mm{R B ,Rc}>l (41) 

mm{R A + R B , Ra + Rc} > 7 (42) 

R B + Rc > 5 (43) 

umx{R A + Rb,Ra + Rc,Rb + Rc} <7. (44) 

From d40l l and (|43l , we must have maxji?^ + Rb,Ra + 
Rc} > 7.5. This means (144-b cannot be satisfied, and hence 
the rate of re = 1 is not achievable using SW-FDF. 
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